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© Image stabilize photographing apparatus. 



© This specification discloses a photographing ap- 
paratus which has detecting means for detecting the 
shake of the photographing apparatus, deflecting 
means for deflecting an optical image on the basis 
of the detection signal of the detecting means, and 
signal processing means for processing an image 
signal output from an image pickup element to shift 
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an electircal image formed by the image pickup 
element and in which chromatic aberration created 
by the deflecting means or a shake of high fre- 
quency component which could not be completely 
corrected by the deflecting means is electrically 
corrected. 
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IMAGE STABILIZE PHOTOGRAPHING APPARATUS 



BACKGROUND OF THE INVENTION 



Field of the Invention 

This invention relates to an image stabilize 
photographing apparatus, and particularly to an im- 
age stabilize photographing apparatus suitable for 
the image pickup optical system of a video cam- 
era, an electronic still camera or the like in which 
the movement of an image on the surface of an 
image pickup element when the Image pickup ap- 
paratus is inclined by vibration or the like is cor- 
rected to thereby enable little blurred images to be 
obtained. 



Related Background Art 

There have heretofore been proposed various 
image stabilize apparatuses In which the movement 
of an image on the surface of an image pickup 
element caused by the vibration, inclination or the 
like of the image pickup apparatus is corrected so 
that a still image may be obtained. 

For example, U.S. Patent No. 3,212,420 pro- 
poses an image stabilize apparatus in which, as 
shown in Figure 2 of the accompanying drawings, a 
refraction type variable apex angle prism P Is 
mounted forwardly of an image pickup optical sys- 
tem S and the apex angle of the variable apex 
angle prism P is varied correspondingly to the 
vibration of the image pickup apparatus to thereby 
deflect an image on an image pickup surface and 
correct the movement of the image. 

In the. method as shown in Figure 2 wherein 
correction means by the variable apex angle prism 
is disposed forwardly of the image pickup optical 
system to thereby correct the movement of the 
image caused by the vibration of the image pickup 
apparatus, the presence of the color dispersion 
effect in the material of the variable apex angle 
prism would cause a chromatic difference of mag- 
nification proportional to the focal length f of the 
image pickup optical system S and the degree of 
dispersion of the variable apex angle prism P, thus 
deteriorating the imaging performance. 

For example, when a light of any reference 
wavelength Xp deflected by the variable apex angle 
prism P passes through the variable apex angle 
prism P and thereafter enters the image pickup 
optical system S in parallelism to the optic axis of 
the image pickup optical system S, a light of other 
wavelength X n (n = 1, 2, 3, ...) enters the image 
pickup optical system in the subsequent stage at 



an emergence angle of inclination r n (an included 
angle between the optic axis and the direction of 
incidence) (n = 1, 2, 3, ...) corresponding to the 
degree of dispersion of the material of the variable 

5 apex angle prism P. The chromatic difference of 
magnification Ay n (n = 1, 2. 3, ...) by the light of 
each wavelength X n caused at this time by the 
influence of the variable apex angle prism P can be 
expressed by the following equation (1): 

10 Ay n - f Man r n 

(n = 1,2,3,...) (1) 

Assuming at this time that, for example, as 
conditions for manually photographing by the use 
of a handy video camera, the angle of inclination 6 

15 of the deflected image corresponding to the shake 
of the apparatus with respect to the optic axis of 
the Image pickup optical system S (hereinafter 
referred to as the compensation deflection angle) is 
3*, the focal length f of the image pickup optical 

20 system S is 50 mm and use is made of silicone 
rubber in which the refractive indices of the refrac- 
tion type variable apex angle prism P for R light 
(red: Xr= 610 nm), G light (green: X Q * 530 nm) 
and B light (blue: X B « 460 nm) are n R = 1.4052, 

25 n Q = 1.4097 and n B = 1.4141, respectively, the 
chromatic difference of magnification Ay n between 
channels obtained from the above-mentioned equa- 
tion (1) is Ay B - -28 urn and A yR = 18 urn with G 
light as the reference. 

30 Generally, to maintain the ordinary imaging 
performance, it is considered to be desirable that 
the width of the chromatic difference of magnifica- 
tion between channels be less than 5-10 nm. 
Accordingly, the conventional method has suf- 

35 fered from the problem that as described above, 
chromatic difference of magnification occurs great- 
ly and the imaging performance is deteriorated. 

In contrast, Japanese Laid-Open Patent Ap- 
plication No. 61-223819 proposes an image sta- 

40 bilize optical system having refraction type image 
deflecting means disposed forwardly of a photo- 
taking lens, and chromatic aberration correcting 
means for correcting aberration created by said 
refraction type Image deflecting means. 

45 However, this system has required an actuator 
such as a motor for driving said chromatic aberra- 
tion correcting means eccentrically relative to the 
optic axis, which has led to the tendency that the 
entire apparatus including the optical system be- 

50 comes bulky. 

Also, the conventional variable apex angle 
prism has been formed of a visco-elastic material 
such as silicone rubber or liquid and therefore has 
encountered a great difficulty in following vibration 
of a high frequency (e.g. ten and several Hz or 
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higher). This has led to the problem that good 
correction cannot be accomplished for image blur 
based on minute vibration of high frequency com- 
ponents, for example, in the photographing from an 
automobile, a helicopter or the like. 

On the other hand, U.S. Patent No. 4,623,930 
discloses a technique using an electrical means to 
stabilize an image formed on the . image pickup 
surface of CCD or the like against unexpected 
vibration. 

SUMMARY OF THE INVENTION 

It is a first object of the present invention to 
provide a photographing apparatus in which an 
image is optically stabilized and at the same time, 
an electrical image signal is processed to stabilize 
the image. 

It is a second object of the present invention to 
provide a photographing apparatus in which the 
vibration of an image having relatively high fre- 
quency components which could not be completely 
corrected when an image was optically stabilized is 
electrically corrected. 

It is a third object of the present invention to 
provide a photographing apparatus in which the 
derioration of an image based on chromatic aberra- 
tion created by optical image deflecting means, for 
example, a variable angle prism, is prevented. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figures 1 and 4 are schematic diagrams show- 
ing the essential portions of first and second 
embodiments, respectively, of the present inven- 
tion. 

Figure 2 illustrates the optical system of an 
image stabilize photographing apparatus in 
which chromatic difference of magnification oc- 
curs. 

Figure 3 is an illustration showing the positional 
relation among the amounts of image shift. 
Figure 5 is a schematic diagram showing some 
essential portions of a third embodiment of the 
present invention. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Figure 1 is a schematic diagram showing the 
essential portions of a first embodiment of the 
present invention as it is applied to a three-plate 
type CCD color camera (image pickup apparatus). 

In Figure 1, the reference numeral 101 des- 
ignates a variable apex angle prism as optical 
image deflecting means. 



The variable apex angle prism 101 is remov- 
ably mounted forwardly of a photo-taking optical 
system 102 in such a manner that it is difficult for 
the other aberrations (distortion, etc.) than chro- 
5 matic aberration to occur. 

The photo-taking optical system 102 comprises 
a zoom lens. 

The reference numeral 103 denotes a color 
dividing prism for dividing the light beam from the 
10 photo-taking optical system 102 into three color 
lights, i.e., red (R), green (G) and blue (B). 

In the present embodiment, images based on 
the respective color lights are formed on the pho- 
tosensitive surfaces of image pickup elements 104- 
75 1 06 each comprising a CCD by the photo-taking 
optical system 102 through the color dividing prism 
103. 

The reference numerals 107-109 designate im- 
age shift circuits as electronic image shift means 

20 corresponding to R light, G light and B light, re- 
spectively. Each of the image shift circuits 107-109 
has an A/D converter, an image memory a D/A 
converter, etc. 

Images formed on the surfaces of the image 

25 pickup elements by the image pickup optical sys- 
tem 102 are converted into image information of 
each color light by the image pickup elements 104- 
106 and input to the image shift circuits 107-109. 
At this time, image memory read-out addresses are 

30 controlled by a calculation circuit 116, whereby the 
positions of the images are two-dimensionally shift- 
ed. 

The reference numeral 113 denotes an angle 
sensor as a camera angle detector. The angle 

35 sensor 113 comprises a gyroscope or the like and 
detects angles of inclination <f> x and 4> v resulting 
from the vibration of the image pickup apparatus. 

The reference numeral 100 designates driving 
means having, for example, gimbals structure. The 

40 driving means 100 mechanically or magnetically 
drives the prism apex angles of the variable apex 
angle prism 101 in two x and y directions on the 
basis of output signals 4> x and 4> y from the camera 
angle detector 113. 

45 The reference numeral 1 1 1 denotes a deflec- 
tion angle detector which detects the apex angles 
of the variable apex angle prism 101 in x direction 
and y direction and outputs detection signals e x and 

6y. 

so The reference numeral 112 designates a focal 
length detector which detects the focal length of 
the image pickup optical system 102 in a predeter- 
mined zoom position. The image pickup optical 
system 102 may be comprised of a. lens system of 

55 a single focal length, and in this case, the focal 
length is constant. The reference numeral 116 de- 
notes a calculation circuit which calculates the 
amount of image shift by a method to be described 



3/4/2008, EAST Version: 2.2.1.0 



5 



EP 0 410 419 A2 



6 



by the use of output signals from the deflection 
angle detector 111 and the focal length detector 
112 and a signal from an ROM 117 storing therein 
the refractive indices n R) n G and n B of the material 
of the variable apex angle prism 101 for the re- 
spective color lights R, Q and B. 

The reference numeral 110 designates an en- 
coder which converts signals from the image shift 
circuits 107-109, for example, into standardized 
image signals of the NTSC type or the PAL type. 
The encoder 110 includes means for 7 correction, 
outline correction, white balance, etc. 

Description will now be made of a method of 
correcting the movement of the image on the sur- 
faces of the image pickup elements caused when 
the image pickup apparatus vibrates in the present 
embodiment. 

First, in the present embodiment, the angles of 
inclination <fr x and 4> v by the vibration or the like of 
the image pickup apparatus are detected by the 
camera angle detector 113, and on the basis of the 
result of the detection, the apex angle of the vari- 
able apex angle prism 101 as the optical image 
deflecting means is varied by the driving means 
100 to thereby correct the movement of the im- 
ages. 

That is, the optical image deflecting means 
two-dimensionally deflects the images formed on 
the respective image pickup elements 104-106 by 
the image pickup optical system 102, thereby opti- 
cally correcting the movement of the images. At 
this time, the deviation of the images based on 
chromatic aberration created when the apex angle 
of the variable apex angle prism 101 is varied is 
shifted by electronic image shift means and is 
corrected thereby. That is, in the present embodi- 
ment, the image shift circuits 107-109 constituting 
the electronic image shift means effect image shift 
(trimming) two-dimensionally for each channel in 
accordance with the direction and angle of deflec- 
tion of the optical image deflecting means and the 
focal length of the image pickup optical system 
102. 

In the present embodiemnt, the image signals 
of the CCD's 104, 105 and 106 are processed by 
the use of the shift circuits 107, 108 and 109 
(image signal processing means), respectively, but 
in principle, the shift circuit 108 can be eliminated 
if design is made such that the image with a 
certain channel, for example, the Q channel, as the 
reference channel coincides with the images 
formed by the other two channels. 

Let it be assumed that the amounts of image 
shift of the respective color lights in X and Y 
directions relative to the image pickup elements 
104-106 are AX R , AY R , AXq, AY q , AX b and AY B . 
These values are found by the calculation circuit 
116 on the basis of the value of the apex angle of 
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the variable apex angle prism 101 detected by the 
deflection detecting circuit 111, the value of the 
focal length of the image pickup optical system 
102 detected by the focal length detector 112, and 
5 the values of the refractive indices n R , n G and n B of 
the material of the variable apex angle prism 101 
for the respective color lights stored in the ROM 
117. 

Figure 3 is an illustration showing an example 

w of the positional relation among the then amounts 
of image shift AX R , AY R> AXq, AY q , AX b and AY B . 

When as previously described, the focal length 
of the image pickup optical system is f and the 
emergence angle of inclination from the variable 

75 apex angle prism is r n , the chromatic aberration 
Ay n created by a variation in the apex angle of the 
variable apex angle prism 101 can be found by the 
aforementioned equation (1), i.e., 
Ay n » ftan r n . 

20 Accordingly, when the apex angles of the vari- 
able apex angle prism in X direction and Y direc- 
tion are e x and e y , respectively, and the refractive 
index of the material of the variable apex angle 
prism is n, chromatic difference of magnification 

25 can be found from the equation (1). 

So, the amounts of image shift AX Rl AY R| AXq, 
AY q , AX b and AY B are found by the calculation 
circuit 116 on the basis of the following equations: 
AX R = ftan{(n R - 1)6*} 

30 AY R = ftan{(n R - 1)* y } 
AXq = ftan{(n G - 1) €k } 
AY g = ftan{(n G - l) €y } 
AX B = ftan{(n B - 1)e x } 
AY B = ftan{(n B - 1)^} 

35 The image shift circuits 107-109 effects the 
shift of the images in conformity with the amounts 
of image shift found by the calculation circuit 116, 
and transmit the then image signals to the encoder 
110. 

40 The encoder 110 converts the signals from the 
image shift circuits 107-109 into standardized im- 
age signals of the NTSC type or the PAL type. 

In the present embodiment, the chromatic dif- 
ference of magnification created by the angle of 

45 deflection of the variable apex angle prism 101 is 
corrected in the manner described above, and as a 
whole, the movement of the images by the vibra- 
tion of the image pickup apparatus is corrected 
well. 

so In the present embodiment, instead of the an- 
gle sensor, an angular velocity sensor may be 
used as the camera angle detector 113 to detect 
the angular velocity, and use may be made of the 
output signal thereof which has been integrated, or 

55 the angular acceleration which has been double- 
integrated. 

Further, as proposed in Japanese Laid-Open 
Patent Application No. 61-269572, design may be 

4 
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made such that the shake of the camera is de- 
tected from the image signal obtained by the im- 
age pickup apparatus, by an image processing 
circuit corresponding to the camera angle detector 
1 13 and is corrected thereby. 

Figure 4 is a schematic diagram showing the 
essential portions of a second embodiment of the 
present invention. 

In this embodiment, a signal system is newly 
added to the embodiment of Figure 1 to improve 
the image stabilizing characteristic as an image 
stabilize image pickup apparatus. 

Since the driving means 100 and the variable 
apex angle prism 101 are mechanically connected 
together, the frequency which can respond to vi- 
bration is low, e.g. up to the order of 10 Hz. 
Accordingly, it is difficult to effect correction for 
vibration having a frequency component higher 
than this frequency. 

So, in the present embodiment, the correction 
of the movement of images when the image pickup 
apparatus vibrates minutely at a high frequency, 
e.g. of 10 Hz or higher is effected by image-shifting 
all channels by the same amount in the same 
direction by the image shift circuits 107-109. 

Generally, the vibration of the image pickup 
apparatus is great in amplitude for low frequency 
components (with 0-10 Hz) and small in amplitude 
for high frequency components (10 Hz or higher). 

In the present embodiment, the movement of 
images of low frequency components and great 
amplitude is corrected chiefly by optical deflecting 
means and the movement of images of high fre- 
quency components and small amplitude is cor- 
rected by electronic image shift means and as a 
whole, the movement of images based on a wide 
range of oscillation frequency and amplitude is 
corrected. 

In the present embodiment, the differences (<*>* 
- e x ) and (<f> y - e y ) between the output values <f> x and 
4> v as the angles of inclination from the camera 
angle detector 113 and the angles of deflection e x 
and e v when the apex angle of the variable apex 
angle prism 101 is varied are information corre- 
sponding to the amount of the angle of deflection 
which the driving means 100 and the variable apex 
angle prism 101 could not completely follow. 

So, in the present embodiment, the amount of 
deflection which the driving means 100 and the 
variable apex angle prism 101 could not com- 
pletely follow, i.e., the under-corrected amount, is 
input to the calculation circuit 116 and the images 
are electronically shifted and corrected In the direc- 
tion opposite to minute vibration by the image shift 
circuits 107-109, whereby there are obtained im- 
ages whose vibration has been precisely corrected 
even for high frequencies. 

In the present embodiemnt, the amounts of 



image shift AX Rl AY R , AXq, AY q , AX 8 and AY B 
when the correction accompanying minute vibra- 
tions of high frequencies is effected simultaneously 
with the chromatic aberration correction of the first 
5 embodiment for the electronic image shift means 
are: 

AX R = ftan{(n R - l)e„ + (<*>*- *x)} 
AY R = ftan{(n R -1) 6y + (<f>y«y)} 
AXq = ftan{(n Q - 1)e x + <<K - * x )} 

10 AYq =* f *tan{(n G - 1)«y + (4>y - <y)> 
AX B = ftan{(n B - 1)e x + (<*> x - <*)} 
AY B = f •tan{(n B - 1)^ + (+ y - * y )} 

Here, if the amounts of image shift reach too 
great values (several percent or more of the size of 

76 the picture plane), it will cause the breakage of the 
picture plane by jmage shift, or the distortion or 
shading created by the image pickup optical sys- 
tem 102 will be observed as vibrating on the output 
picture plane, thus causing the quality of image to 

20 be deteriorated. Therefore, in the present embodi- 
ment, it is preferable to provide limiter means for 
limiting the amounts of image shift so as to be of 
the order of several percent of the size of the 
picture plane. 

25 Figure 5 is a schematic diagram of the essen- 
tial portions neighboring the electronic image shift 
means of a third embodiment of the present inven- 
tion. 

In this embodiment, there is shown image shift 

30 means for directly controlling the read-out positions 
of image pickup elements. The reference numerals 
204-206 designate image pickup elements such as 
CCD's or saticons, and the reference numerals 
207-209 denote read-out area control circuits for 

35 controlling the read-out positions of images. 

In the image pickup elements 204-206, the 
timing (the phase for each of three color lights) and 
scanning speed of the scanning signal of an elec- 
tron beam are changed, whereby apparently the 

40 images can be minutely shifted. 

In the present embodiment, the scanning signal 
is controlled on the basis of the amounts of image 
shift AX R , AY r , AX g , AY g . AX b and AY B from the 
calculation circuit 116, not shown, to thereby obtain 

45 an effect similar to that of the second embodiment. 
Also, in the solid state image pickup elements 
such as CCD's, the clocks of CCD transfer regis- 
ters in the horizontal direction (H direction) and the 
vertical direction (V direction) are controlled, where- 

50 by apparently the images can be shifted by a 
technique similar to that proposed, for example, in 
U.S. Patent No. 4,593,31 1 . 

Such image shift means can also be realized in 
a color camera of one plate type. 

55 That is, the image is read out by a conven- 
tional method, whereafter the image is divided into 
color lights R, G and B, which are input to the 
image shift circuits 107-109 of Figure 1 and image 
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shift is effected therein, whereby a similar effect 
can be obtained. 

According to the present invention, there can 
be achieved an image stabilize image pickup ap- 
paratus suitable for a video camera, a broadcasting 
handy camera or the like in which the movement of 
an image caused by the vibration or the like of the 
image pickup apparatus is corrected by the use of 
optical image deflecting means and electronic im- 
age shift means to thereby prevent a reduction in 
the resolving power of the Image and which is 
made compact as a whole and yet can quickly and 
highly accurately correct the movement of the im- 
age, for example, of a wide range of oscillation 
frequency. 

Also, according to the present invention, there 
can be achieved an image stabilize image pickup 
apparatus characterized in that the influence of the 
color dispersion of the material of a variable apex 
angle prism can be corrected well and therefore 
the use of VAP material of high refractive index 
becomes possible and that the VAP driving angle c 
can be made small and driving means can readily 
be made compact. 

This specification discloses a photographing 
apparatus which has detecting means for detecting 
the shake of the photographing apparatus, deflect- 
ing means for deflecting an optical image on the 
basis of the detection signal of the detecting 
means, and signal processing means for process- 
ing an image signal output from an image pickup 
element to shift an electircal image formed by the 
image pickup element and in which chromatic ab- 
erration created by the deflecting means or a 
shake of high frequency component which could 
not be completely corrected by the deflecting 
means is electrically corrected. 



Claims 

1. A photographing system having converting 
means for converting an optical image formed by 
an objective lens into an electrical signal, said 
photographing system including: 

detecting means for detecting the shake of said 
photographing system; 

deflecting means: for deflecting said optical image 
on the basis of the detection signal of said detect- 
ing means; and 

means for shifting an image formed on the basis of 
said converting means. 

2. A photographing system according to Claim 1, 
wherein said shifting means processes the elec- 
trical signal of said converting means. 

3. A photographing system according to Claim 2, 
further including calculating means for calculating 
the amount of shift of said image on the basis of 
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the amount of deflection by said deflecting means. 
4. A photographing system according to Claim 3, 
wherein said deflecting means is a variable angle 
prism. 

s 5. A photographing system according to Claim 4, 
wherein said converting means produces electrical 
signals corresponding to a plurality of color compo- 
nents, and said shifting means processes at least 
one of said electrical signals on the basis of the 

70 result of the calculation by said calculating means. 

6. A photographing system according to Claim 1, 
further including producing means for producing 
the amount of shift of said image on the basis of a 
signal regarding the difference between the detec- 

75 tion signal of said detecting means and a deflection 
signal regarding the amount of deflection by said 
deflecting means. 

7. A photographing system according to Claim 6, 
wherein said deflecting means is a variable angle 

20 prism. 

8. A photographing system according to Claim 7, 
wherein said converting means produces electrical 
signals corresponding to a plurality of color compo- 
nents, and said means for shifting the image pro- 

25 cesses at least one of said electrical signals on the 
basis of the result of the production by said pro- 
ducing means. 

9. A device for deflecting an optical image formed 
by an objective lens, by optical image deflecting 

30 means on the basis of the output from a sensor for 
sensing the shake of said optical image, including: 
converting means for converting said optical image 
into an electrical signal; and 
means for shifting an electrical image formed by 

35 said converting means on the basis of information 
regarding the amount of image deflection by said 
optical image deflecting means. 

10. A device according to Claim 9, wherein said 
shifting means processes the electrical signal of 

40 said converting means. 

11. A device according to Claim 10, further includ- 
ing calculating means for calculating the amount of 
shift of said image on the basis of the amount of 
deflection by said deflecting means. 

45 12. A device according to Claim 11, wherein said 
deflecting means is a variable angle prism. 

13. A device according to Claim 12, wherein said 
converting means produces electrical signals cor- 
responding to a plurality of color components, and 

so said shifting means processes at least one of said 
electrical signals on the basis of the result of the 
calculation by said calculating means. 

14. A device according to Claim 9, further including 
producing means for producing the amount of shift 

55 of said Image on the basis of a signal regarding the 
difference between the detection signal of said 
sensor and a deflection signal regarding the 
. amount of deflection by said deflecting means. 

6 



Version: 2.2.1.0 



11 



EP 0 410 419 A2 



15. A device according to Claim 14, wherein said 
deflecting means is a variable angle prism. 

16. A device according to Claim 15, wherein said 
converting means produces electrical signals cor- 
responding to a plurality of color components, and 5 
said means for shifting the image processes at 
least one of said electrical signals on the basis of 

the result of the production by said producing 
means. 

10 
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